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(54) Video camera including multiple image sensors 

(57) A digital camera comprises a first lens (7 in 20) " 
for focusing a first image, a second lens (7 in 21) for 
focusing a second image, a first sensor (5 in 20) for con- 
verting a light intensity and color pattern of the first im- 
age into a first electrical signal, a second sensor ( 5 in 
21) for converting a tight intensity and color pattern of 
the second image into a second electrical signal, a 
processing unit (8 to 1 1 ) for processing the first electrical 
signal and the second electrical signal, and a switch (23) 
for selectively coupling either the first electrical signal or 
the second electrical signal to the processing unit. 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 5 

The present invention relates to a video camera 
and. more particularly to a digital video camera includ- 
ing a plurality of lenses and image sensors and common 
digital video signal processing circuitry for processing 10 
signals from each of the image sensors. 

2. Description of the Related Art 

Visual communication over point-to-point telecom- '5 
munication networks has become an increasingly useful 
and economic alternative for information exchange in 
business and consumer applications. A common ele- 
ment of all visual communication systems is the video 
input device. To date, video input devices have generally 20 
been based on variations of traditional video camcorder 
technology. 

However, traditional camcorder-type video camer- 
as impose severe limitations on the format and capabil- 
ities of present day video conferencing. For example. 25 
there often occurs a need to switch camera views quick- 
ly from one room view to another or from face-to-face 
view to face-to-document view. Present methods for 
achieving these various views incorporate motor driven 
pan/tilt stages and/or multiple cameras. 30 

Unfortunately, such methods for achieving multiple 
views can be cost prohibitive since a plurality of com- 
plete camera units each including a pan/tilt stage are 
expensive to purchase, maintain and operate. In addi- 
tion, the speed at which the typical pan/tilt stage oper- 35 
ates limits the desirability of such a system which often 
must operate in real time. For example, during a multi- 
media conference in which a plurality of speakers are 
seated in one conference room, it may be desirable to 
switch views depending on which speaker is talking. If -to 
one camera having a pan/tilt stage is provided, by the 
time an operator positions the camera using the remote 
pan/tilt stage to capture a view of an active speaker, the 
speaker may change, thus requiring a further camera 
position change. A plurality of complete camera units 
can minimize this problem although this solution may be 
cost prohibitive. 

The present invention is provided to overcome the 
above-noted disadvantages associated with the prior 
art. 50 

SUMMARY OF THE INVENTION 

The present invention relates to a digital camera in- 
cluding a first lens for focusing a first image, a second 55 
lens for focusing a second image, a first sensor for con- 
verting a light intensity and color pattern of the first im- 
age into a first electrical signal, a second sensor for con- 
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verting a light intensity and color pattern of the second 
image into a second electrical signal, a processing unit 
for processing the first and second electrical signals and 
a switch for selectively coupling either the first electrical 
signal or the second electrical signal to the processing 
unit. 

Accordingly, the present invention provides a de- 
vice in which images received through a plurality of lens- 
es can be processed by the same processing circuit. An 
advantage of using a plurality of lenses is that a first lens 
can be a fixed focus lens that provides a relatively wide 
angle view of the room for face-to-face communication, 
for example, and a second lens can be a variable iris C- 
mount lens with manual focus control to provide higher 
resolution for face-to-document transmission, for exam- 
ple In the alternative, a plurality of lenses can be ar- 
ranged around the periphery of a conference room and 
the outputs fed to a common video processing unit. An 
operator can then control from which lens data is active- 
ly being received, by use of a keyboard or keypad pro- 
vided on a controller or videophone, for example, or au- 
tomatically by programming a camera controller. 

BRIEF DESCRIPTION OF THE DRAWINGS 

So that one skilled in the art to which the subject 
invention appertains will better understand how to prac- 
tice the present invention, preferred embodiments of the 
invention will be described in detail below with reference 
to the accompanying drawings, in which: 

FIG. 1 illustrates a block diagram of a typical digital 
video camera; 

FIGs. 2A-2D are block diagrams of a dual lens dig- 
ital camera according to embodiments of the 
present invention: 

FIG . 3 depicts a use for a dual lens camera arrange- 
ment according to an embodiment of the present 
invention: and 

FIG. 4 illustrates a multi-lens camera arrangement 
according to an embodiment of the present inven- 
tion. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Referring to the drawings in which like reference nu- 
merals identify similar or identical elements. Fig. 1 illus- 
trates a digital video camera arrangement that may be 
used for implementing preferred embodiments of the 
present invention. The digital video camera can consist 
of a digital movie camera as disclosed by Hitachi in its 
MV-DS6A digital camera demo system, for example. 
Other examples of digital video cameras that may be 
used for implementing preferred embodiments of the 
present invention include those disclosed in U.S. Patent 
Nos. 5.343.243. 5.264.944 and 5.371 .540. for example. 

As depicted in Fig. 1 . a typical digital video camera 
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consists of a sensor portion 1 and a processing portion 
2. Sensor portion 1 includes driver 3. charge coupled 
device (CCD) 5. correlated double sampling/automatic 
gain control (CDS/AGC) 6 and lens 7. Processing por- 
tion 2 includes analog to digital converter (ADC) 1 1 dig- 
ital signal processor (DSP) 9. microcontroller 10. timing 
circuitry s. compression circuit 1 5. memory 1 6. digital to 
analog converter (DAC) 12. mixer 13. and. optionally, 
monitor 13. 

Operation of a typical digital video camera that can 
be used for implementing embodiments of the present 
invention is generally well known in the art and will there- 
fore be described in only brief detail below. 

During recording, incident light from an image pass- 
es through lens 7 and is converged onto CCD 5. CCD 
5 converts the light intensity and color pattern of the im- 
age into electrical signals. Using timing and control sig- 
nals generated in timing circuit 8 and provided to CCD 
5 through driver 3. the electrical signals are output from 
CCD 5 by raster scans and input to CDS/AGC 6. The 
CDS portion of CDS/AGC 6 eliminates a low-frequency 
noise component from the electrical signals. The AGC 
portion of CDS/AGC 6 provides automatic gain control 
for preventing later stages, and particularly ADC 11. 
from being overloaded. CDS/AGC 6 outputs raw CCD 
analog signal data that is input to ADC 1 1 . ADC 1 1 acts 
as a sampling A/D converter, sampling the raw CCD an- 
alog signal data at predetermined intervals and output- 
ting digital data to DSP 9. Under control from microcon- 
troller 10. DSP 9 performs low level video processing 
on the video information, including color matrix conver- 
sion, clip level adjustment, gamma compensation and 
Y/C digital multiplexing, for example. 

DSP 9 outputs eight-bit digital multiplexed lumi- 
nance and chrominance data in a nominal 4:2:2 or 4:1 : 
1 format. The digital data output by DSP 9 can then be 
compressed by compression circuit 15 and stored in 
memory 16, for example. Alternatively the digital data 
output by DSP 9 can be immediately processed and dis- 
played. 

Microcontroller 10 can consist of an eight-bit micro- 
controller such as Hitachi's H8/300. 
Microcontroller 10 performs system functions such as 
loading DSP 9 registers with power-up values for white 
balance, iris and gain control, etc. Microcontroller 10 al- 
so includes a serial input/output port (I/O) 14 for provid- 
ing a serial interface for user control of camera functions 
during operation. 

The digital data stored in memory 16 can be read 
and input to a 2 channel digital-to-analog converter DAC 
12 such as Hitachi's HD49307. The analog output of 
DAC 12 can then be fed through an analog luminance/ 
chrominance mixer 13 such as Mitsumi's 1029 and out- 
put as an NTSC format composite video signal for dis- 
play on video monitor 18. 

As shown in Fig. 2A. according to a preferred em- 
bodiment of the present invention, two individual image 
sensor portions 20 and 21 are provided. A switch 23 is 



provided for selectively switching the raw CCD signal 
output from image sensor portion 20 or 21 to the input 
of ADC 11. Switch 23 can be any switch suitable for 
switching video signals and can consist of a mechanical 

$ switch or a solid state switch, for example, although to 
reduce switching time and overall cost, a solid state 
switch is preferred. Switch 23 can be controlled by mi- 
crocontroller 1 0. For example, a user can input a switch- 
ing command through serial I/O 14. using a remote key- 

io board, joystick or other input device. Switch 23 can be 
provided either as a separate and distinct unit or can be 
incorporated into the processor circuitry. 

In addition, according to another embodiment of the 
present invention as shown in Fig. 2B. each sensor por- 

is tion includes its own ADC. Each ADC 25 and 26 con- 
verts the raw CCD signal output from image sensor por- 
tion 20 and 21 . respectively, and outputs digital data that 
is input to switch 23. Switch 23 is selectively controlled 
by microcontroller 1 0 to output the digital data from ADC 

20 25 or ADC 26 to DSP 9. where it is processed. According 
to this embodiment of the present invention, it would be 
necessary to provide eight additional wires between 
each sensor portion and switch 23 for communicating 
the eight bit digital data from the ADCs. In order to re- 

25 duce the number'of wires that must be provided be- 
tween each* sensor portion and switch 23. it may be pref- 
erable to provide a high speed parallel to serial convert- 
er such as that used in the P1 394 serial interface stand- 
ard, for converting the parallel data output by the ADCs 

30 to serial, and transferring the serial data to switch 23. 
The data could then be transferred back to parallel form 
for processing by DSP 9. Transferring digital serial data 
between the sensor units and the processing unit pro- 
vides excellent transmission characteristics resulting in 

35 low noise and error correction capabilities. 

According to the embodiment of the present inven- 
tion depicted in Fig. 2C, the number of electronic com- 
ponents required for each of the sensors can be further 
reduced, thus reducing the cost of each sensor. Since 

40 each CCD 5 is driven with the same drive signals, a com- 
mon driver 3 could be provided on the processor portion 
of the circuitry for driving each CCD 5. as shown. In ad- 
dition, a common CDS/AGC 6 could be provided be- 
tween switch 23 and ADC 11 . Accordingly, each sensor 

45 would consist essentially of a lens 7 and CCD 5. The 
outputs of CCDs 5 could then be appropriately selected 
by switch 23 to provide the desired CCD output to the 
input of CDS/AGC 6. The output of CDS/AGC could then 
be converted by ADC 11 and processed by DSP 9 as 

50 described above. In general, relatively low level signals 
are provided at the outputs of the CCDs. Accordingly, 
due to noise considerations, this embodiment of the 
present invention would be most useful for arrange- 
ments where the sensors are provided relatively close 

55 the processing electronic circuitry {e.g.. in a compact 
mutti-lens video camera). 

The electrical connection between each sensor and 
the processing electronics need not be hard wired. For 
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example, according to an embodiment of the present in- 
vention depicted in Fig. 2D a known RF transmission 
technique may be utilized for transmitting signals be- 
tween each sensor and the processing electronics. As 
shown, the processing electronics include RF transmit- 5 
ter 51 for RF modulating the timing signals from timing 
circuit 5 and antenna 52 for transmitting the modulated 
signals. According to this embodiment of the present in- 
vention each sensor includes a receiving antenna 54 
for receiving the modulated timing signals. RF receiver io 
29 for demodulating the received timing signals and 
processing electronic circuitry 55 for performing the nec- 
essary processing on the received timing signals for 
converting the demodulated signals from analog to dig- 
ital and for formatting the digital data into the proper for- '5 
mat for driving CCp 5. Since each sensor unit receives 
common drive signals, a single frequency can be used 
for modulating the drive signals. 

Each sensor also includes an RF transmitter 27 for 
RF modulating the analog video data signal output by 20 
CDS/AGC 6. The modulated video data signal is then 
transmit via antenna 23. The processing electronics in- 
clude antenna 53 for receiving the modulated video data 
signal. The received signal is demodulated by RF re- 
ceiver and forwarded to ADC 11 for processing. Since 25 
each sensor is transmitting different video data, each 
sensor unit could be arranged to transmit at a different' 
frequency. Microcontroller 10 could then selectively 
"switch" the output of the desired sensor to the input of 
ADC 11 by selectively controlling RF receiver 50 to 30 
choose which frequency signal to demodulate. This em- 
bodiment of the present invention would be useful in an 
environment where it is not practical to provide numer- 
ous cables between the sensors and the processing 
electronics, for example. 35 

The arrangements depicted in Figs. 2A, 2B. 2C and 
2D allow a user to select from which lens an image is to 
be recorded or viewed. By using common drive and 
processing electronics for the two sensor portions 20 
and 21. camera functionality can be increased while -to 
keeping component costs low. 

As depicted in Fig. 3. according to an embodiment 
of the present invention, camera 30 can be arranged 
with a first lens 31 and a second lens 32. For example, 
lens 31 can consist of an 8m/f2.0 fixed focus lens for is 
providing a relatively wide-angle view of a room and lens 
32 can consist of a 1 6mm variable iris C mount lens with 
manual focus control, for example, for providing high 
resolution document transmission capability. Lens 31 
can be arranged for a room view of a conference partic- so 
ipant 34 to provide face-to-face communication during 
a videotelephone conference, for example. Second lens 
32 can be arranged for viewing document 33. 

During a videotelephone conference, the present 
invention permits fast switching between an image of ss 
the room as seen through lens 31 or an image of docu- 
ment 33 as seen through lens 32. without the need for 
expensive and tediously slow moving pan/tilt stages 



and/or a plurality of complete camera units. The video 
information from camera 30 can be transmitted to re- 
mote terminal 35 which can be a remote computer ter- 
minal having multimedia capabilities, for example. In ad- 
dition to having the capability to display the video infor- 
mation from camera 30. an operator at terminal 35 is 
capable of controlling camera 30 to selectively switch 
between views from lens 31 or lens 32. In the alternative, 
conference participant 34 can be provided with a control 
pad for selectively switching between views from lens 
31 or lens 32. 

According to another embodiment of the present in- 
vention as depicted in Fig. 4. a plurality of sensor units 
40A-40H are arranged around the periphery of confer- 
ence room A. for example. Each sensor unit 40A-40H 
is similar to sensor portion 20 and 2 1 as depicted in Figs. 
2A or 2B. for example. A processor unit 45. similar to 
the processor depicted in Fig. 2A. includes a remotely 
controllable switch that is capable of selectively coupling 
the outputs of sensor units 40A-40H to the processing 
circuitry in processor unit 45. The remotely controllable 
switch can be operated either locally by an operator in 
room A or remotely by an operator at terminal 46 in room 
B. An operator either in room A or in remote room B can 
then manually switch between sensor units 40A-40H for 
different views of conference room A. The present in- 
vention thus provides a very cost effective way of ena- 
bling a plurality of views of a room without the need of 
providing a plurality of complete camera units each hav- 
ing separate video processing electronics. Since each 
sensor unit requires minimal electronics, the sensors 
can be provided in a very compact- discrete unit. 

According to yet another embodiment of the present 
invention, the image sensors can be arranged in a pre- 
determined configuration on a platform provided in the 
center of a conference room, for example. Using known 
digital video signal processing techniques, the video 
outputs from two or more adjacent sensors can be dig- 
itally combined by the processing electronics to achieve 
a wide angle view and/or a high resolution image of the 
conference room. In addition, the video outputs from all 
of the sensors can be digitally combined to achieve a 
seamless 360° view of the conference room. By simul- 
taneously performing known processing techniques on 
the video data output from each of the sensors, elec- 
tronic pan/tilt and zoom capabilities can be provided. In 
other words, since the cost of each sensor unit is mini- 
mal compared to the cost of a complete camera unit, a 
large number of sensor units can be arranged in any 
desired configuration. The video outputs from the cam- 
era units can then be combined and/or processed to 
achieve various video effects and views. 

Although the present invention has been described 
using CCD image sensors, it is not intended to be limited 
to any particular type of image sensor. For example, em- 
bodiments of the present invention could utilize CMOS 
image sensors in place of. or in combination with. CCD 
image sensors. 
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It will be appreciated that the foregoing description 
and drawings are only intended to be illustrative of the 
present invention. Variations, changes, substitutions 
and modifications of the present invention may occur to 
those skilled in the art without departing from the spirit 
and scope of the present invention. Accordingly, it is in- 
tended that the present invention be limited only by the 
scope of the appended claims. 



Claims 

1. A digital camera comprising: 

a first lens for focusing a first image: 

a second lens for focusing a second image: 

a first sensor for converting a light intensity of 

the first image into a first electrical signal: 

a second sensor for converting a light intensity 

of the second image into a second electrical 

signal: 

a processor for processing the first and second 
electrical signals: and 

a switch for selectively directing either the first 
electrical signal or the second electrical signal 
to the processor. 

2. A digital camera according to Claim 1 . wherein. the 
first lens comprises a fixed focus lens and the sec- 
ond lens comprises a variable focus lens. 

3. A digital camera according to Claim 1 : wherein the 
first and second sensors comprise charge coupled 
devices. 

4. A digital camera according to Claim 1 . wherein the 
processor comprises a digital signal processor 

5. A digital camera according to Claim 1 . wherein the 
first sensor converts the light intensity and a color 
pattern of the first image into the first electrical sig- 
nal and the second sensor converts the light inten- 
sity and a color pattern of the second image into the 
second electrical signal. 

6. A digital camera comprising: 



7. A digital camera according to Claim 6. wherein two 
lenses and two sensors are provided. 

8. A digital camera according to Claim 6. wherein each 
5 of the plurality of sensors comprises a charge cou- 
pled device. 

9. A digital camera according to Claim 6. wherein the 
processor simultaneously processes the informa- 

io tion output by other of the plurality of sensors along 
with the information output by said one of the plu- 
rality of sensors. 

10. A method of operating a digital camera, comprising 
J 5 steps of: 

receiving a plurality of images, each from a sep- 
arate one of a plurality of lenses: 
converting each of the plurality of images into 
corresponding electrical signals: 
selectively processing one of the electrical sig- 
nals corresponding to one of the plurality of 
converted images: and 

controlling which one of the corresponding 
electricafsignals is processed in said process- 
ing step. 
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a plurality of lenses: 

a plurality of sensors, each corresponding to a 
different lens, respectively, and each outputting so 
electrical information corresponding to an im- 
age as seen through each of the respective 
lenses: 

a processor for processing the information out- 
put by one of the plurality of sensors: ss 
a selector, for selectively providing the informa- 
tion from a selected one of the plurality of sen- 
sors, to the processor 
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